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The 1997 amendments to the Individuals with Disabilities Education Act required states to provide ac- 
cess to the general curriculum and alternate assessments for students with disabilities who were un- 
able to participate in statewide assessments. For this study, we examined the curricular focus of alternate 
assessments using performance indicators in math, language arts, and functional skills from 31 states. 
Experts in math education, language arts, and severe disabilities, along with a group of stakeholders 
(i.e., teachers and administrators), examined the performance indicators relative to their alignment to 
national standards and curricula. Experts and stakeholders identified states that had alternate assess- 
ment performance indicators that were clearly aligned to math or language arts and those that did not. 
A subgroup also considered the functionality of the indicators. Through a series of discussions, ex- 
perts and stakeholders identified features of the performance indicators that exemplified alignment with 
general or functional curricula, including specificity of content, wording, required response, and grade- 
or age-level appropriateness. The results suggest that alternate assessments have a strong focus on aca- 
demic skills but also reflect an additive curricular approach linking academic and functional skills. 


Curriculum, the content of instruction, has been one of the 
most controversial areas in education because determining 
what students will learn in school reflects both educational 
philosophy and societal values (Doll, 1996; Queen, 1999). As 
societal perspectives change, so does the focus of school cur- 
riculum. One of the strongest current influences on curriculum 
is the school accountability movement. Nearly all states have 
curriculum standards, and most have statewide assessments to 
address the extent to which the standards are being met. 

Since the 1997 amendments to the Individual with Dis- 
abilities Education Act (IDEA), students with disabilities 
must be included in statewide assessment systems. IDEA re- 
quired that as of July 2000, states provide an alternate as- 
sessment for students unable to participate in the statewide 
assessment system. Although not limited to this population, 
most students with severe disabilities (severe cognitive dis- 
abilities, multiple disabilities, severe autism, deaf-blindness) 
require an alternate assessment. Societal perspectives about 
individuals with severe disabilities have changed dramatically 
in the last three decades, with concurrent shifts in curricular 
focus. First, the shift was from developmental models to func- 
tional models. A second shift added a general curriculum 
focus to the functional models. Most recently, there has been 
interest in aligning alternate assessments and general curricu- 
lum. The interesting question that arose in the creation of 
many of these alternate assessments is what curriculum to use 
as their foundation (i.e., academic or functional). 


Developmental Models 

In the mid-1970s, when the Education For All Handicapped 
Children Act of 1975 (P.L. 94-142) established the right for 
all students with disabilities to have a free, appropriate edu- 
cation, many schools created their first services for students 
with severe disabilities. In the absence of a curriculum model 
for these new services, professionals adapted preexisting in- 
fant and early childhood curriculum for students in Grades K 
through 12. This approach, known as the developmental model, 
was based on the assumption that the educational needs of stu- 
dents with severe disabilities could best be met by focusing 
on their mental age as derived from a developmental assess- 
ment. Early textbooks and chapters in textbooks emphasized 
early childhood skills like Piagetian cognitive stages and self- 
care (Bricker & Iacino, 1977; Robinson & Robinson, 1983; 
Stephens, 1977). Researchers demonstrated methods to teach 
skills, and many studies were conducted in institutions for in- 
dividuals with mental retardation (e.g., Azrin & Armstrong, 
1973; Azrin & Foxx, 1971; Azrin, Schaeffer, & Wesolowski, 
1976; Gold, 1972). 

Functional Models 

In a classic paper, L. Brown, Nietupski, and Hamre-Nietupski 
(1976) challenged the field to reject the developmental model 
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and instead use the criterion of ultimate functioning in the 
community to select skills based on current and future envi- 
ronments. Haldermann v. Pennhurst State School and Hospi- 
tal (1977/1979) and other landmark cases of this era involving 
residents in institutions ( Lessard v. Schmidt, 1972; Souder v. 
Brennan, 1973; Wyatt v. Stickney, 1972) resulted in a large pop- 
ulation of individuals with severe disabilities moving into com- 
munity contexts. During the 1980s, many new community 
alternatives emerged for individuals with severe disabilities. 
L. Brown et al. (1979) introduced the term functional to refer 
to a new curriculum model that promoted community access 
by targeting skills needed to function in daily life. L. Brown 
et al. (1979) described four domains of functional skills — 
community, recreation, domestic, and vocational — that became 
the new content areas for curriculum. The shift in thinking 
about curriculum was widespread. Most textbooks and re- 
sources on curriculum published in the 1980s and early 1990s 
used functional life domains as chapter organizers (Browder, 
1987, 1993; Cipani & Spooner, 1994; Falvey, 1986; Snell, 
1983, 1987, 1997; Westling & Fox, 1995). Westling and Fox 
(2000) cited 18 authors from this era who supported this shift 
to functional skills. Most intervention studies in the late 1980s 
and early 1990s focused on functional life skills (Nietupski, 
Hamre-Nietupski, Curtis, & Shrikanth, 1997). By the late 
1980s, strong consensus had emerged among professionals 
that curriculum should focus on age-appropriate functional 
skills (Meyer, Eichenger, & Park-Lee, 1987). Thus, the shift 
from a developmental model to a functional curriculum model 
was transformational (i.e., a paradigm shift). 

During this era, curriculum guides that provided resources 
for planning functional skills instruction also emerged. An in- 
teresting feature of these guides was the assumption that not 
all students would learn all the skills listed; instead, a priori- 
tization process was presented for selecting a subset of skills 
(Ford et al., 1989; Giangreco, Clonginger, & Iverson, 1993; 
Wilcox & Bellamy, 1987). Thus, in contrast to the scope and 
sequence found in general education curriculum, functional 
curriculum guides were viewed as catalogs from which pri- 
ority skills could be selected. Knowlton (1998) described the 
need for the curricula of students with severe disabilities to be 
personalized. Students’ Individualized Education Programs 
(IEPs) became the tool for defining these individual curricu- 
lar priorities. 

Additive Models 

Some other changing societal perspectives created additive 
curricular priorities but did not totally shift the primary focus 
from functional skills. In the 1990s, many new resources 
emerged regarding how to include students with severe dis- 
abilities in general education schools and classrooms with a 
strong emphasis on social inclusion (e.g., Certo, Haring, & 
York, 1984; Downing, 1996; Haring & Romer, 1995). By the 
mid-1990s, research (Nietupski et al., 1997) and textbooks 


(Cipani & Spooner, 1994; Ryndak & Alper, 1996) reflected 
this new interest in social inclusion. 

Complementing both community and school access 
was an additive curricular focus that promoted student self- 
determination. This was reflected in growing resources on 
honoring student preferences through person-centered plan- 
ning (Mount & Zwernik, 1988; O’Brien, 1987), offering 
choices during daily routines (F. Brown, Belz, Crosi, & We- 
nig, 1993), and teaching students self-determination skills like 
goal-setting and problem-solving (Wehmeyer, Agran, & 
Hughes, 1998). A large body of research emerged on preference 
assessment (Lohrmann-O’Rourke & Browder, 1998), choice- 
making (Kern et al., 1998), and teaching self-determination 
skills (Hughes, Korinek, & Gorman, 1991). Textbooks provided 
more emphasis on self-determination in curriculum planning 
(Browder, 2001 ; Snell & Brown, 2000; Westling & Fox, 2000). 

With continued efforts to promote school inclusion, find- 
ing ways for students to participate in the general curriculum 
also became an additive curricular focus (Downing, 1996; 
Ryndak & Alper, 1996). Giangreco et al. (1993) described two 
basic approaches to adjusting the general educational pro- 
gram. The first was using multilevel curriculum, which called 
for students to learn the same curriculum content but with dif- 
ferent expectations for outcome. For example, in a second- 
grade social studies lesson on their neighborhood, some 
students could focus on naming community helpers and oth- 
ers could provide information on where they live in the com- 
munity (e.g., street address). In Giangreco et al.’s second 
option, curriculum overlapping, students learned functional or 
social skills in the context of an academic lesson. For example, 
a student with severe disabilities might attend a biology or 
French class to receive exposure to the general curriculum but 
with expectations for learning social skills like tum-taking 
rather than the class content. A few studies have emerged that 
demonstrate how students can learn functional curriculum in 
general education classes (e.g., Hunt, Staub, Alwell, & Goetz, 
1994), but much more literature is available on the social ben- 
efits of inclusion (Cole & Meyer, 1991). In general, although 
some resources describe general curriculum access, research 
currently provides minimal guidance on how to achieve this 
access for students with severe disabilities. 

Aligning Assessments and Curriculum 

The 1997 IDEA Amendments had two requirements that cre- 
ated the need for educators to determine what the curriculum 
focus should be for students with severe disabilities. The law 
not only mandated the use of alternate assessments but also 
required access to the general curriculum. Given the wide- 
spread adoption of a functional curriculum focus, it is not 
surprising that many states first developed their alternate 
assessments to evaluate performance of functional skills 
(Thompson & Thurlow, 2001). While surveying national ex- 
perts to validate the performance indicators for alternate as- 
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sessment, Kleinert and Kearns (1999) found support for focus- 
ing on functional skills. In fact, the highest rated performance 
indicators, in order, were integrated environments, function- 
ality, chronologically age appropriate, and choice-making, re- 
flecting the curricular foci of the last two decades. In contrast, 
9 of the 44 respondents questioned the focus on functional do- 
mains and suggested instead using general academic content 
areas as vehicles for achieving functional outcomes. As a re- 
sult of this validation, Kentucky changed the focus of its al- 
ternate assessment from functional life domains (personal 
management, recreation/leisure, and vocational) to academic 
domains that mirrored the general curriculum (language arts, 
math, science, social studies, and either arts/humanities or phys- 
ical education). By 2001, most states were using state standards 
(typically academic) as the basis for their alternate assess- 
ments or linking functional skills to these standards (Thomp- 
son & Thurlow, 2001). Thus, alternate assessment seemed to 
reflect a potential shift in thinking about curriculum for stu- 
dents with severe disabilities. States struggled with the ques- 
tion of whether students with severe disabilities should be in 
a separate functional curriculum, in the general curriculum 
with adaptations, or in both. 

Early resources on alternate assessment stressed the need 
for this process to be linked to the state’s standards and access 
the general curriculum (Kleinert & Kearns, 2001; Thompson, 
Quenemoen, Thurlow, & Ysseldyke, 2001). Between 1998 and 
2001, many states began developing curriculum guides that 
described how to extend state standards and gave examples 
of skills to be targeted for alternate assessment. These per- 
formance indicators provide an important resource for under- 
standing curriculum for students with severe disabilities. Some 
states created these performance indicators only for academic 
content areas (e.g., language arts, math), some organized them 
by functional domains (e.g., personal management, commu- 
nity skills), and some did both (Browder et ah, 2002). These 
organizational structures suggest a tension between the wide- 
spread adoption of a functional curriculum approach and the 
newer concept of access to general curriculum for students 
with severe disabilities. Is access to the general curriculum 
transformational, like the shift that occurred from the devel- 
opmental model? Is it additive, like the recent focus on social 
inclusion and self-determination? Or, is it cosmetic in simply 
renaming the same functional skills as access to general cur- 
riculum? 

The purpose of this study was to examine the alignment 
of the content on alternate assessments to academic standards 
and functional life domains. We were interested in how and 
to what extent alternate assessments were aligned with cur- 
ricula within states. Data were collected from content experts 
and stakeholders who reviewed the examples of extended state 
standards provided in states’ alternate assessment materials. 
We limited our focus to math and language arts because if a 
state had used an academic content area for extensions, these 
were the ones most often represented. Our hypothesis was that 
curriculum transformation would be evident if these examples 


were closely aligned with the standards of the National Coun- 
cil of Teachers of English (NCTE) and the National Council 
of Teachers of Mathematics (NCTM) and were credible to 
stakeholders as representatives of math and language arts 
curricula. The impact on curriculum would be additive if the 
examples not only reflected math and language arts standards 
but also continued to represent functional curriculum and chro- 
nological age appropriateness. In contrast, a cosmetic change 
would be evident in listings of functional skills under the 
headings of math or language arts that did not align with NCTE 
and NCTM standards and were not credible to stakeholders 
as reflecting these content areas. 

Method 

We used a method suggested by Crocker and Algina (1986) 
for conducting a content validation study that included the fol- 
lowing steps: 

1 . defining the performance domains of interest, 

2. selecting a panel of qualified experts, 

3. providing a structured framework for the 
process of matching items to the performance 
domain, and 

4. collecting and analyzing the responses. 

Surveys and focus groups were used to collect data. The fol- 
lowing research questions were of interest: 

1 . Are alternate assessments aligned to national 
math standards? 

2. Are alternate assessments aligned to national 
language arts standards? 

3. Are functional performance indicators aligned 
to general curriculum? 

4. Do functional performance indicators reflect 
the major life domains? 

5. What age or grade levels are reflected on alter- 
nate assessments? and 

6. Considering the recent focus on functional 
skills for this population, is the curricular focus 
of alternate assessment performance indicators 
transformative, additive, or consmetic? 

Defining the Performance Domain 
and Sampling Performance Indicators 

Through the review of state Web sites and individual contacts 
with state administrators, written guidelines for alternate as- 
sessment systems for 42 states were found between July and 
November of 2001. Because some states had only a few, if 
any, performance indicators in their written guidelines, the 
criterion for inclusion in this study was for a state to have at 
least five performance indicators in language arts and math or 


214 THE JOURNAL OF SPECIAL EDUCATION VOL. 37/NO. 4/2004 


five in functional domains (some states “linked back” to their 
state standards through the use of functional domains). This 
process yielded sets of skills from a total of 3 1 states that were 
included in this analysis. Of these 3 1 states, 16 used only math- 
ematics and language arts domains, 4 used only functional 
performance domains, and 11 used both. Some states’ alter- 
nate assessments included additional academic domains (e.g., 
science, social studies). These additional domains were ex- 
cluded from the study. 

Even though states used varying labels to describe their 
most basic level of skills included in their alternate assess- 
ments, we refer to these as “performance indicators” for clar- 
ity and consistency. Because some states had a large number 
of performance indicators (e.g., more than 1,000), a sampling 
strategy was designed to produce a representative sample of 
performance indicators for each state. The process for each 
state follows: 

1 . Count all the performance indicators for each 
domain (e.g., the math domain might have 
1,000 indicators). 

2. Identify the number of performance indicators 
needed for a representative sample using the 
Krejcie and Morgan (1970) sample size table 
(e.g., 278 is representative for 1,000). 

3. Randomly select performance indicators. 

4. Type these randomly selected performance 
indicators into a list clustered by states. 

5. Replace state’s names with pseudonyms to 
conceal their identities. 

We then created separate packets for each curricular area with 
27 states’ lists each for the mathematics and language arts 
packets and 15 for the functional packet. A total of 1,684 in- 
dicators were sampled from the mathematics domain, 1,759 
were sampled from the language arts domain, and 1,564 were 
sampled from the functional domain. 

Selection of Participants 

To obtain diverse views about how well alternate assessment 
performance indicators conform to performance domains, we 
asked multiple groups to serve as reviewers. These groups in- 
cluded experts in severe disabilities, math education, and lan- 
guage arts education and special education teachers and 
administrators. We first identified one primary expert in each 
field — math education, language arts education, and special 
education for severe disabilities — from our own university 
faculty to serve as a coordinator in each area. These coordi- 
nators identified experts from across the United States and in- 
vited the participation of at least 1 1 experts in each area. The 
group of national curricular experts who participated was 
composed of six math educators, seven language arts edu- 
cators, and five special educators of individuals with severe 
disabilities. 


The special education teachers and administrators from 
North Carolina who served on an advisory council for this 
alternate assessment project were invited to participate as a 
group of stakeholder reviewers. Nine teachers, two local 
school administrators, and three state-level employees chose 
to participate. All nine teachers and the local administrators 
were also involved in a model demonstration project that 
called for them to implement alternate assessments with stu- 
dents with severe disabilities in their classrooms and had thus 
undergone a series of training sessions on alternate assess- 
ment. The state-level employees were involved in various as- 
pects of the development of the alternate assessment system 
for North Carolina. The stakeholders also received Web site 
information for NCTE and NCTM as a reference to national 
standards. 

A third group, which as a research panel to review pre- 
liminary results, was composed of two national experts in 
alternate assessment; five researchers in low-incidence disabil- 
ities from North Carolina; our research coordinators in math, 
language arts, and special education; and a researcher from 
the state’s developmental disabilities council. 

Data Collection for Curriculum 
Alignment Review 

Data collection included an open-ended survey and focus 
group interviews. Three separate surveys were prepared for 
each of the lists of performance indicators (i.e., math, lan- 
guage arts, and functional). Each expert and stakeholder re- 
spondent received the list of performance indicators and the 
open-ended survey to use in reviewing and analyzing the lists 
of performance indicators provided for one curricular area. 
Sample questions from the survey are provided in the Ap- 
pendix. 

The national experts only responded to their area of ex- 
pertise (e.g., math educators only reviewed math lists and 
completed the math survey). The experts in severe disabilities 
reviewed the functional indicators and were also asked to con- 
sider how well these indicators followed general curriculum 
in language arts and math. Stakeholders provided written re- 
sponses to the survey and were given the opportunity to com- 
plete all three sets. A total of 6 math experts, 7 language arts 
experts, 5 severe disabilities experts, and 14 stakeholders re- 
turned the surveys. The 14 stakeholders completed 13 lan- 
guage arts, 1 1 math, and 9 functional surveys. The research 
panel was only given one survey (functional skills) to use to 
become familiar with the task. During the focus group, they 
received the full set, including math, language arts, and func- 
tional indicator lists. A flow chart depicting the procedure for 
the review of performance indicators is displayed in Figure 1 . 

Focus groups were conducted with the stakeholders and 
research panel. The first focus group interview was conducted 
with the stakeholder group in a full-day session. In the morn- 
ing, the stakeholders reviewed their individual written re- 
sponses in small groups. In the afternoon, the research panel 


215 



FIGURE 1. Procedure for review and data analysis of alternate assessment performance indicators. 
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and our research team (the authors) joined the group as non- 
participant observers. As the stakeholders shared informa- 
tion from their small groups, the facilitator (first author) wrote 
key points on newsprint. The group then discussed emerging 
themes from the groups, which were also listed on newsprint. 
Then the coordinators in math education, language arts edu- 
cation, and severe disabilities provided summary presentations 
of the results of the written national expert surveys. Detailed 
notes were made of this discussion and distributed to the re- 
search panel the next morning. On the 2nd day, the research 
panel met with two stakeholders (one teacher and one ad- 
ministrator), our research group, and the coordinators in math 
education, language arts education, and severe disabilities to 
discuss the stakeholder and national expert results in detail. 
This focus group session was recorded and transcribed. Dur- 
ing this focus group, participants considered the historical 
context for curriculum in severe disabilities and answered the 
question “Given the advent of alternate assessment, has any- 
thing changed in the curricular focus for students with severe 
disabilities? If so, what?” 

Analysis of the Response Data 

After the focus group meetings, the facilitator wrote a detailed 
memo based on the 2-day discussion and her knowledge of 
curriculum in severe disabilities. Three members of our re- 
search team whose primary area of expertise is research meth- 
odology rather than special education reviewed this memo, 
the survey responses, and the focus group transcripts to iden- 
tify primary themes. These three researchers then met to reach 
consensus on these themes. Next, these three researchers met 
with the three special educators on the team to review and 
interpret the themes. While substantial information was ob- 
tained, the team focused on results that were supported across 
multiple respondents and sources (survey and focus groups) 
using the research questions as a guide. 

Results 

Are Alternate Assessments Aligned 
to National Math Standards ? 

On the surveys, 86% of math experts and 70% of stakeholders 
indicated that some states’ lists of performance indicators were 
clearly linked to mathematical standards. In their surveys, 
most experts and the stakeholders identified South Dakota and 
Colorado as clearly linking their performance indicators to 
math standards. The focus group participants agreed that 
Colorado was an exemplary state in aligning alternate as- 
sessment performance indicators to math standards. On the 
survey, math education experts identified features of the per- 
formance indicators that illustrated a better alignment to math 
standards, including an emphasis on math skills and process 


standards and indicators that were well written and compre- 
hensive. Stakeholders identified the high-quality indicators as 
being “functional skills representing a wide range of levels of 
ability.” Some examples of Colorado’s performance indica- 
tors in math were “make and read simple graphs representing 
meaningful information and relationships,” “demonstrate a 
beginning sense of measurement (e.g., big, little, heavy, light, 
etc.),” “match number symbols with appropriate amount,” and 
“find months and dates on the calendar.” 

Eighty-six percent of math experts and 100% of stake- 
holders said that performance indicators for some states were 
clearly not aligned to math standards. Reasons for identifying 
indicators as not being aligned to math standards included that 
they were too broad or too limited, that they were vague, and 
that they were more like vocational or communication goals 
than mathematical standards. As one stakeholder remarked on 
her survey, “[This state] seems to really push the limit as far 
as what is considered a math competency. It’s like they had an 
idea and kept going with that idea, but then it got away from 
the mathematical concept.” Some examples of poor indicators 
of math were “displays object permanence,” “completes simple 
puzzles, peg boards, form boards,” “demonstrates ability to 
maneuver appropriately in space,” and “sits upright in a wheel- 
chair.” 

In addition to some disagreement between stakeholders 
and experts about whether certain states did a good or a bad 
job of linking performance indicators to mathematical stan- 
dards, there was a disagreement within the expert and stake- 
holder groups. One state was selected as both the best and the 
worst example of alignment of performance indicators to math 
standards. Twenty-nine percent of experts and 40% of stake- 
holders listed this state as a good example, but 20% of experts 
and 40% of stakeholders listed it as a bad example. It is pos- 
sible that the mixed endorsements of this state by members of 
the same area of expertise was in part due to the fact that this 
state had the most indicators listed; therefore, some indicators 
were identified as good examples and others as bad examples. 
None of the specific indicators listed as illustrations in survey 
or focus group examples were listed as both good and bad. 

Are Alternate Assessments Aligned 
to National Language Arts Standards ? 

Eighty-six percent of language arts experts and 100% of stake- 
holders that responded to the survey indicated that some states’ 
lists of performance indicators were clearly aligned to lan- 
guage arts standards. One state identified as clearly linking 
its performance indicators to language arts standards was 
Arizona. Language arts experts identified features of the per- 
formance indicators that illustrated a better alignment to 
language arts standards, including that the indicators clearly 
identified specific behaviors of the students and went beyond 
physical consciousness. Language arts experts also noted that 
states’ good examples of performance indicators included a 
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good scope and range of skills that included all four domains 
of language arts (i.e., speaking, listening, reading, and writing). 
As one expert noted while evaluating Arizona’s indicators, 

I am impressed by these because they . . . discrim- 
inate among those children that meet the standard 
and those that do not. They are not so broad, gen- 
eral, vague, or unclear that nearly all children could 
pass; they are not so specific, narrow, isolated, or 
idiosyncratic that they would be applicable to only 
certain children. 

As with the math domain, stakeholders identified the 
high-quality indicators as being functional and related to basic 
life skills. Some examples of Arizona’s performance indica- 
tors aligned to language arts standards were “copy letters (e.g., 
using computer keyboard, Braille, or print),” “tell story about 
objects/pictures,” “identify main characters,” “recognize name,” 
“match picture to word,” “make lists (e.g., pictorial/word shop- 
ping list),” and “answer questions related to a sequence of 
events.” 

Sixty-seven percent of language arts experts and 78% 
of responding stakeholders said that performance indicators 
for some states were clearly not examples of language arts 
standards. Reasons experts identified indicators as not being 
aligned to language arts standards included that they were too 
limited (e.g., to verbal/nonverbal communication), vague, or 
general; that they were “kindergarten level”; and that they 
lacked representation of all four domains of language arts. 
One expert pointed out that poor examples of some states’ per- 
formance indicators combined activities with standards, pre- 
suming that “any activity that involves language is a language 
activity.” One indicator that exemplified this point is “searches 
for book that has been misplaced.” 

There were some disagreements within the expert and 
stakeholder groups about whether some states did a good or 
a bad job of linking performance indicators to language arts 
standards. The same state that had mixed results in mathe- 
matics also had mixed results among experts and stakehold- 
ers in language arts. For example, 40% of stakeholders listed 
this state as a good example, but 71% of experts and 30% of 
stakeholders listed it as a bad example of alignment of per- 
formance indicators to language arts standards. Like the math 
results, it is possible that the mixed endorsements of this state 
by members of the same area of expertise was in part due to 
the fact that this state had the most indicators listed, allowing 
some indicators to be cited as good examples and others as 
bad examples. Again, none of the specific indicators were 
identified as both good and bad. Another possibility for this 
disagreement may be its placement within the packet; it ap- 
peared at the beginning (9th) of the packet of 27 states to be 
considered. It may have been that reviewers took more time 
to consider the states and indicators that were at the beginning 
of the packet. 


Are Functional Performance Indicators 
Aligned with General Curriculum ? 

Forty percent of severe disability experts and 71% of stake- 
holders indicated that some states’ lists of functional per- 
formance indicators were clearly aligned with the general 
curriculum. In contrast, 60% of experts in severe disabilities 
stated that the states overall did not do a good job of aligning 
the general curriculum with their performance indicators. 

Several of the stakeholders were hesitant in answering 
this question, stating that they were uncertain of the defining 
characteristics of the general curriculum. During the focus 
groups, stakeholders pointed out that they were never trained 
or had never been provided a copy of the general curriculum. 
As one stakeholder said, “There is a general lack of knowl- 
edge about what the curriculum is.” 

One state, Connecticut, was identified by both experts and 
stakeholders as properly accessing the general curriculum. 
Experts pointed out that the indicators addressed literacy and 
numeracy and it was easy to see the alignment between the 
functional skills and academics. Stakeholders also noted that 
the link between functional academic indicators and the gen- 
eral curriculum was clear, with indicators providing detailed 
descriptions of objectives that were tied to future personal in- 
dependence (e.g., “indicate a choice that distinguishes between 
healthy and unhealthy foods”). 

Do Alternate Assessments Reflect 
Major Life Domains f 

Seventy-five percent of the severe disability experts and 88% 
of stakeholders indicated that some states’ lists of perfor- 
mance indicators reflected the major life domains. Experts 
and stakeholders cited two states, Arizona and Connecticut, 
as having functional performance indicators that correctly re- 
flected the major life domains. The experts and stakeholders 
noted that the performance indicators in these states were 
clear, gave good examples, equally addressed all the life do- 
mains, and set high expectations for students. A stakeholder 
remarked about one of the states with good examples, “[This 
state] starts with simple, lower level skills and covers the 
gamut from self-help [and] communication to vocational and 
social skills.” 

There was no consensus among the reviewers concern- 
ing states that were over- or underrepresenting some of the 
major life domains. Most experts and stakeholders tended to 
comment on the poor quality of the performance indicators. 
One expert wrote, “These indicators are biased toward acad- 
emics ... or daily/community living . . . but not the full range.” 
During the focus groups, both the experts and the stakehold- 
ers noted that some of the indicators were passive (e.g., “tol- 
erates face being washed”) or therapy-oriented (e.g., “lifts 
head,” “reach and grasp”). 
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What Age or Grade Levels Are Reflected 
on Alternate Assessments ? 

Among those who reviewed mathematic indicators, 100% of 
experts and 20% of stakeholders thought the indicators rep- 
resented skills appropriate for elementary grades. The re- 
maining 80% of stakeholders showed no clear agreement on 
the range of grades or ages represented by the states’ perfor- 
mance indicators. Fifty-seven percent of language arts experts 
and 33% of stakeholders described the performance indicators 
as representative of skills appropriate for preschool or lower 
elementary grades. Other respondents indicated they were un- 
sure about the age range or that it varied greatly from state to 
state. Forty percent of experts in severe disabilities and 67% of 
stakeholders stated that the states’ functional performance in- 
dicators addressed skills for students of all ages. The remain- 
ing responses varied with regard to the specific age or grade 
ranges represented in the indicators, but respondents tended 
to believe that they most accurately represented lower elemen- 
tary grades, especially kindergarten. Stakeholders identified 
some performance indicators as aimed toward not school-age 
children but infants or young children. 

Is the Curricular Focus Transformative, 
Additive, or Cosmetic ? 

The experts and stakeholders determined that some of the same 
states were not aligned with math and language arts standards, 
even though they labeled their performance indicators with 
these academic categories. That is, some states seemed to have 
made only a cosmetic change by labeling functional skills as 
language arts or math skills. In contrast, most of the experts 
and stakeholders agreed that overall states were aligned with 
math and language arts standards. As one language arts expert 
said in response to the question of whether the states ade- 
quately represented reading/language arts skills, “Taken as a 
total list [all states], I would agree. Some [states’] lists by them- 
selves would not be.” 

Although these academic links were identified, evidence 
was also found for a continuing emphasis on functional skills. 
More than one third (11) of the 31 states used both academic 
and functional domains to organize their alternate assessments. 
Arizona, the state identified as having well-aligned performance 
indicators in language arts, was also identified as correctly rep- 
resenting the major functional life domains. Connecticut, the 
state identified as having good access to general curriculum 
using a functional approach, was also strong in representing the 
major life domains. This comment from one of the math experts 
reflects this additive approach: “There are math skills among the 
life skills.” 

In the research panel, the group focused on the blend of 
academic and functional curriculum that emerged from the 
best examples. In describing what made some states better, 
they noted the functional and academic blend. In considering 


what had changed, they noted the new emphasis on academics 
in alternate assessments. Several focus group members men- 
tioned the value of a functional approach, but differences 
emerged in their views on teaching academic standards. Sev- 
eral expressed concern that a standards-based focus would 
compete with a person-centered functional approach. Others 
embraced an additive approach, as reflected in this comment 
from one of the research panel members: “Kids without dis- 
ability are taught academics. Are kids with disabilities being 
only taught functional things? Kids with disabilities should be 
taught both.” Others noted the field’s confusion and need for 
further work on creating this blend: “We aren’t at the next step 
yet, because we have to be person-centered and follow along 
with general education curriculum at the same time.” 

Discussion 

The performance indicators of three states were determined by 
the individual and group analyses of both experts and stake- 
holders to be in alignment with math and language arts stan- 
dards. Although these results lack the state-by-state specific 
analysis that would permit determining the prevalence of 
states that have succeeded in aligning their performance indi- 
cators for alternate assessment with academic content stan- 
dards, they do suggest that some states have created lists of 
indicators that are accurate representatives of math and lan- 
guage arts. In contrast, they also suggest that some states and 
some indicators, even within the best states, have missed the 
mark. Given that states may be struggling to align performance 
indicators with academic content standards in language arts 
and math, it is interesting to consider how the three states 
identified as doing the best job of this alignment approached 
the task. 

Three States’ Examples 

First, these states did not replace functional curriculum with 
academic general curriculum but rather blended the two to cre- 
ate performance indicators for alternate assessment. For exam- 
ple, Arizona used both academic and life domain categories. 
Connecticut linked functional curriculum to state standards to 
develop its indicators. These states extended standards without 
shifting from one curriculum philosophy to another as many 
states did when adapting an early childhood curriculum to a 
functional curriculum. Instead, these performance standards for 
students with severe disabilities reflect a move toward an addi- 
tive curriculum model. Wehmeyer, Lattin, and Agran (2001) ar- 
gued that access to the general curriculum does not mean that 
all students with disabilities will learn only the general cur- 
riculum; this would be incompatible with their legal right for 
an IEP. Traditionally, however, some students have had no ac- 
cess to the general curriculum because the focus was on an al- 
ternate functional curriculum. Our stakeholder group noted that 
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some special educators are not even familiar with the general 
curriculum. 

A second interesting point in looking at the three states 
identified by experts and stakeholders as having the best ac- 
cess to general curriculum is that they used different frame- 
works to achieve this threading. In a related study, Browder 
et al. (2002) conducted a document analysis to identify how 
states categorized the performance indicators for the alternate 
assessment. Colorado used two curricular categories for its 
alternate assessment: reading/writing and math. After task an- 
alyzing their content standards into 173 benchmarks, they de- 
fined 10 subcategories of skill areas. Two of these categories 
stemmed directly from reading/writing and math. The other 
8 were “access skills”: communication, decision-making/ 
problem-solving, self-advocacy/self-determination, inter- and 
intrapersonal skills, organization, physical-motor, technology 
skills, and career development. The end results were perfor- 
mance indicators with a more traditional academic flavor (e.g., 
“identify solid geometrical figures”), with a more functional 
focus (e.g., “use coins and bills”), or that were access skills 
(e.g., “convey a message understood by another person,” “par- 
ticipate in class discussion”). Thus, Colorado began with two 
categories from the general curriculum and threaded func- 
tional and access skills into these. 

Arizona, which was declared to be strong in language arts 
and use of functional domains, used an approach that involved 
choosing nine academic categories and four functional cate- 
gories to create performance indicators for the alternate as- 
sessment. Arizona’s examples ranged from simple skills like 
“rotate pictures/books to correct left/right and up/down ori- 
entation” to more complex academic responses like “anticipate 
patterns in a familiar story.” The end result was 188 functional 
indicators, including those related to reading and math, and 
3,030 indicators for nine general curriculum areas. In contrast, 
Connecticut, which was notable for its good access to the gen- 
eral curriculum in our study, used a functional curriculum to 
develop performance indicators but organized these by language 
arts/communication and math/quantitative skills. Whether these 
states began with state standards and extended them (Colorado), 
began with a functional curriculum and linked back to acade- 
mic standards (Connecticut), or did both ( Arizona), all produced 
performance indicators that our experts and stakeholders con- 
sidered reflective of good access to general curriculum. 

Has Anything Changed ? 

Nolet and McLaughlin (2000) noted that special education 
students have a history of receiving an alternate curriculum. 
This alternate curriculum may be outlined in a guide (e.g., 
functional curriculum guide) or created through the IEP. They 
proposed that access to the general curriculum may involve 
accommodations or modifications. In contrast, an alternate 
curriculum has separate content and goals from the general 
curriculum. Educators have traditionally used an alternate 


curriculum for students with severe disabilities. In the earliest 
days of educational services, this was an adaptation of early 
childhood curriculum. With the focus on community access, 
curriculum thinking shifted to a focus on functional curricu- 
lum. Self-determination and social inclusion were processes 
of instruction more than content. By offering opportunities for 
interaction with nondisabled peers and providing choices, 
teachers could incorporate these philosophies while continu- 
ing to teach functional skills. Billingsley and Albertson (1999) 
warned educators not to drop functional skills instruction in 
the push toward social inclusion. Before alternate assessment 
forced educators to think about state standards, access to the 
general curriculum could also be achieved by teaching stu- 
dents functional skills in the context of general curriculum ac- 
tivities. One popular approach was to create a matrix to show 
how to embed the student’s IEP goals into general education 
classes (Downing, 1996). Some experts in severe disabilities 
laid the groundwork for the current era by describing how to 
focus on the same content but have different expectations for 
performance (Downing, 1996; Ryndak & Alper, 1996; Snell 
& Brown, 2000). Some experts have proposed using critical, 
or access, skills like communication and choice-making that 
have applicability across multiple contents (Grisham-Brown & 
Kearns, 2001). 

Mehren ( 1998) concluded that if stakes were high enough, 
and if teachers deemed content appropriate, there would likely 
be a shift in the curriculum and instruction to match the con- 
tent sampled by the test. Overall, our findings suggest that ex- 
perts and stakeholders accept performance indicators that 
blend functional and general curriculum. This suggests a trend 
toward merging these two types of curricula for students with 
severe disabilities. Our findings do not show that overall states 
have achieved this blend, nor that the indicators are relevant 
for all students. The participants found examples, across and 
within states, of skills that were not good representations of 
math or language arts standards or that were not functional. 
The stakeholder focus groups also expressed the view that the 
performance indicators were not relevant for students with the 
most severe disabilities. Most of the math and language arts 
examples had also been derived from the early grades, which 
may make them inappropriate for secondary students with se- 
vere disabilities. What do seem to be emerging are some good 
examples of how to retain the traditional focus on functional 
skills for students with severe disabilities while also access- 
ing the general curriculum. We also still need to enhance the 
quality of the examples of extended standards so that they 
meet the dual priorities of being both representative of the 
content area and relevant for students with severe disabilities. 

Limitations 

In interpreting these results it is important to realize that the 
focus of this study was only the performance indicators that 
states used to provide examples of standards to be assessed. 
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We did not address the format or quality of the alternate as- 
sessment itself. Thompson and Thurlow (2001) found that 
states developed a variety of formats for the alternate assess- 
ment. Most used a portfolio, but others used a checklist or 
some form of IEP analysis. A limitation of our research is that 
we did not examine the alternate assessment itself to deter- 
mine if the curriculum reflected in the performance indicators 
was also reflected in the assessment itself. One reason this 
would have been difficult is that many states allow teachers 
to determine the specific content of the alternate assessment. 
Consistent with the view that curriculum for students with se- 
vere disabilities must be personalized (Knowlton, 1998; Weh- 
meyer et al., 2001), most states specify the content areas and 
standards to be assessed but allow teachers the option of defin- 
ing what skills address these standards (Browder et al., 2002). 
A few seem to have moved away from this perspective by 
using a checklist of skills that must be completed for all stu- 
dents. Connecticut uses this checklist approach. In contrast, 
Colorado uses performance on specified standards, and Ari- 
zona uses a combination of a checklist, a parent questionnaire, 
and an activity-based performance assessment. 

A second limitation is that we focused on the performance 
standards to be used for the alternate assessment. Most states 
have two types of standards: content standards and perfor- 
mance standards. Content standards set the broad curriculum 
goals, whereas performance standards translate that content 
into specific knowledge and skills that students are expected to 
demonstrate (Nolet & McLaughlin, 2000). During the stake- 
holder focus group, there was some discussion about whether 
the group should be looking at the content standards from 
which the performance indicators had been derived. Our per- 
spective was that these content standards typically were the 
states’ academic standards. Our interest was in whether the 
performance standards specified for students with severe dis- 
abilities bore any resemblance to the general curriculum. Cu- 
ban ( 1 992) noted that there are three levels of curriculum — the 
intended curriculum, the taught curriculum, and the learned 
curriculum. Whereas the content standards are the intended 
curriculum for all students, the performance indicators are more 
likely to be the taught curriculum for students with severe dis- 
abilities. These indicators were also sometimes several levels 
of translation from the original content standards. Browder et 
al. (2002) found that states varied in how they translated con- 
tent standards into performance indicators for the alternate as- 
sessment. Some used as many as five levels of task analysis 
in extending the standard to reach the performance indicator. 
For example, Kansas defined the general standard, extended 
standard area, benchmark, indicator, and a clarifying exam- 
ple. For all states, we chose the most specific level for review. 
If the participants had examined all levels of extension or the 
content standard, their perspectives may have differed. 

A third limitation of this study is that reviewers were not 
instructed to make judgments of each individual state listed 
in the three packets of performance indicators. Due to the 
sheer number of states and indicators, such a task would have 


been extremely time-consuming. Instead, reviewers were asked 
to review all the states’ lists of performance indicators, select 
states they considered to be the best and worst and provide 
examples of performance indicators that illustrated their opin- 
ion. Therefore, each state was not be individually described 
or rated. 

A fourth limitation is the lack of agreement between the 
stakeholders and experts for two research questions — the age 
levels of the curriculum and whether the functional indicators 
accessed general curriculum. Disagreement also occurred in 
perspectives on one state that some viewed as a good exam- 
ple and others rated as a bad example. Math and language arts 
educators identified the performance indicators as appropri- 
ate for early elementary skills, whereas the special education 
teachers and administrators had a wide range of opinions about 
the age ranges. This may reflect special educators’ lack of 
knowledge about general education. During our focus group, 
stakeholders reported their lack of knowledge of the general 
curriculum and national standards several times. This dis- 
agreement may also reflect the lack of focus on grade levels 
in functional curriculum. Instead, functional curriculum may 
be intended to teach children across grade levels skills that are 
necessary in adulthood. This lack of focus on grade level may 
also explain why experts in severe disabilities had varied opin- 
ions about the age levels of the functional indicators. The ex- 
perts in severe disabilities also did not agree with stakeholders 
that the functional indicators accessed the general curriculum. 
Most experts in severe disabilities thought that most indica- 
tors were not linked to math and language arts. The third area 
where disagreement occurred was in the rating for one state. 
This state’s original list had a large number of performance 
indicators (more than 3,000) because it cross-referenced every 
language arts and math skill with a functional life domain. 
The representative sample also was large. Some respondents 
may have focused on the better examples, while others fo- 
cused on the weaker ones. 

A fifth limitation may lie in the method used to deter- 
mine how performance indicators were aligned and the con- 
clusion drawn. Based on expert and stakeholders’ opinions 
about the indicators, we concluded that alternate assessment 
is creating an additive curricular focus with a blending of aca- 
demic and functional curriculum. Direct analysis of the states’ 
documents could suggest a different conclusion. For example, 
more than half of the states used only math and language arts 
domains, with no functional domains, for their alternate as- 
sessments. Further research is needed analyzing the indicators 
within these domains to determine whether they are academic, 
functional, or both. 

Given these limitations, the contribution of our study is 
in describing how the states’ examples of extended standards 
reflect curriculum philosophy for students with severe disabil- 
ities. Most states developed the standards to be used for the 
alternate assessment through a group consensus process with 
stakeholders that included special educators, parents, and gen- 
eral educators (Thompson & Thurlow, 2001). Through our first- 
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hand experience in this process for our own state; interactions 
with colleagues from other states; and the discussion article 
of Ford, Davem, and Schnorr (2001), we realized that alter- 
nate assessment was creating the need to discuss curriculum 
philosophy for students with severe disabilities. This study 
was the first to explore curriculum as reflected in performance 
indicators for alternate assessments for students with severe 
disabilities. 

Recommendations for Alternate 
Assessment Practices 

States need to be involved in ongoing quality enhancement of 
the performance indicators used for alternate assessments. 
Two questions that we propose planning groups ask when re- 
vising performance indicators are (a) Is this skill clearly aligned 
with the content area it is purported to assess? and (b) Is the 
performance indicator meaningful to the lives of students with 
severe disabilities? In our study, content area experts in math 
and language arts identified some performance indicators as 
aligned with NCTE and NCTM standards and others as not 
being representative of their disciplines. Similarly, states need 
to involve content area specialists in validating the performance 
indicators used in alternate assessments. Extending state stan- 
dards in content areas to be applicable for students with the 
most severe disabilities is a complex task. Once examples are 
generated, submitting them for review to content area spe- 
cialists can help ensure that the intended curriculum (e.g., 
math, language arts) is reflected in items to be assessed. 

Performance indicators also need to be validated by 
stakeholders and experts in severe disabilities as relevant and 
applicable. For example, the performance indicator “can de- 
velop a written paragraph containing a topic sentence, sup- 
porting ideas, and contributing ideas” describes the focus of 
many statewide writing assessments or even college writing 
courses, but is not applicable to alternate assessment. In con- 
trast, the performance indicator “trim nails and observe growth 
of nails over the month” focuses on trivial, isolated skills, and 
“enjoys riding in a car” sets the low expectation of only pas- 
sive responding. 

Ongoing work also is needed to ensure that what is ac- 
tually assessed reflects the standards. States that specify the 
items to be assessed (e.g., through a checklist) can specify the 
link between each of these performance indicators and the 
state standard it addresses. In contrast, specifying the exact 
skills to be assessed is not consistent with most experts’ rec- 
ommendations to personalize curriculum for students with se- 
vere disabilities through the IEP process (Giangreco et ah, 
1993; Knowlton, 1998). An alternative is to provide examples 
of performance indicators and allow teachers to identify the 
specific skills to assess from the student’s IEP. If teachers se- 
lect the specific skills to be incorporated in the alternate as- 
sessment, some checks and balances are needed to ensure that 
these actually link to state standards. To do this, states need 
to include an evaluation of the match between the skill as- 


sessed and the state standard it addresses as part of the eval- 
uation of the alternate assessment. It also is important for states’ 
examples of performance indicators to model a clear link. 

A third recommendation for practice is to use both ac- 
cess to the general curriculum and functional curriculum in 
specifying performance indicators. The states whose examples 
satisfied both content area experts and stakeholders in our 
study used this blended curriculum approach. To be consistent 
with IDEA 1997, alternate assessment should address state 
standards and access to the general curriculum. The No Child 
Left Behind Act of 2002 requires assessing all students in 
reading, math, and science. Assessing students with severe 
disabilities in these areas may require specifying real-life in- 
dicators for academic standards. Most studies demonstrating 
acquisition of academics for students with severe disabilities 
have targeted functional academics; that is, the use of aca- 
demic skills in daily living (Browder & Snell, 2001). Cross- 
referencing general and functional curriculum provides a way 
to make academic standards applicable for students with se- 
vere disabilities through the use of real-life examples. In con- 
trast, using only functional curriculum as the framework for an 
alternate assessment misses the point of assessing the progress 
of all students on state standards. 

In summary, the IDEA 1997 requirements for alternate 
assessment are stimulating educators to consider access to 
general curriculum for students with severe disabilities. Merg- 
ing functional and academic curriculum provides a way to cre- 
ate performance indicators for alternate assessment that 
address both the content area and students’ need to learn skills 
that are meaningful in real life. Alternate assessment does not 
mean shifting from functional to general curriculum, nor does 
it mean making merely a cosmetic change. Some states have 
begun to define performance indicators that do reflect aca- 
demic content area standards for use in alternate assessment. 
In contrast, work is needed to develop more high-quality ex- 
amples for these performance indicators. 
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Appendix 

Sample Questions From Survey 
on Alternate Assessment Performance Indicators 


Language Arts and Math Questions 

1. Quickly scan the entire list of skills across all of the states. Do you 
agree that these reflect reading/language arts (or math) skills that 
are needed in daily living? 

2. How well do they reflect national standards in reading/language 
arts (math)? 

3. Again, consider the breadth of the entire list of skills. What age or 
grade level would you assign? 

4. Are some states’ skills more clearly linked to reading/language arts 
(math)? If so, which five states appear to do a better job of linking 
the skills to reading/language arts? Why are they better? 

5. Are some states’ skills clearly not linked to reading/language arts 
(math)? If so, which five states appear inadequate? Why do you 
consider them inadequate? 


Functional Questions 

1. Consider the breath of the entire list of skills. Approximately what 
percentage of the skills listed address quality of life? 

2. Do some states do better than others in addressing quality of life? 
If so, which states do you consider better? Explain why you con- 
sider them better. 

3. Are there any categories of skills that are not represented? If so, 
which ones? Are there categories that are overrepresented? If so, 
which ones? 

4. Do some states do a better job representing the major life 
domains? If so, which states? 

5. To what extent do these skills access the general curriculum? Do 
some states access the general curriculum better? If so, which 
ones? 

6. Do some states do a better job representing reading/language arts 
(math) skills? If so, which ones? Why do you consider them bet- 
ter? 

7. What age level do these skills seem to address? 


